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MAGNETIC RESONANCE IMAGING WITH RESOLUTION AND CONTRAST 
ENHANCEMENT 

Background of the Invention 
Field of the Invention 

5 The present invention is directed to a system and method for improving the resolution and 

tissue contrast in MRI. 

Description of Related Art 

The best current source of raw image data for observation of a complex soft tissue and 
bone structure is magnetic resonance imaging (MRI). MRI involves the transmission of RF 

10 signals of predetermined frequency (e.g., approximately 15 MHZ in some machines, the 
frequency depending upon the magnitude of magnetic fields employed and the magnetogyric 
ratio of the atoms to be imaged). Typically, exciting pulses of RF energy of a specific frequency 
are transmitted via an RF coil structure into an object to be imaged. A short time later, radio- 
frequency NMR responses are received via the same or a similar RF coil structure. Imaging 

15 information is derived from such RF responses. 

In MRI, a common imaging technique is the formation of images of selected planes, or 
slices, of the subject being imaged. Typically the subject is located in the static magnetic field 
with the physical region of the slice at the geometric center of the gradient field. Generally, each 
gradient will exhibit an increasing field strength on one side of the field center, and a decreasing 

20 field strength on the other side, both variations progressing in the direction of the particular 
gradient. The field strength at the field center will thus correspond to a nominal Larmor 
frequency for the MRI system, usually equal to that of the static magnetic field. The specific 
component of a gradient which causes the desired slice to be excited is called the slice selection 
gradient. Multiple slices are taken by adjusting the slice selection gradient. 
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However, MRI often introduces the following technical challenges. Many of the 
anatomical structures to be visualized require high resolution and present low contrast, since, for 
example, many of the musculoskeletal structures to be imaged are small and intricate. MRI 
involves the use of local field coils to generate an electromagnetic field; such local field coils 
form a non-uniform illumination field. MRI images can also be noisy. 

hi particular, MRI has the following limitations in resolution and tissue contrast. 
Although current MRI machines can achieve relatively high intra-plane resolution, the inter-slice 
resolution is not so good as the intra-plane resolution; also, the inter-slice resolution is limited 
by the ability of the system to stimulate a single spatial slice or section. Although tissue contrast 
can be adjusted by selecting the right pulse sequence, analysis of a single pulse sequence is not 
enough to differentiate among adjacent similar tissues. In other words, the resolution is typically 
poor in the out-of-plane dimension, and the contrast is typically low between soft tissue 
structures. 
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Summary of the Invention 

It will be readily apparent from the foregoing that a need exists in the art to overcome the 
above-noted limitations of conventional MRI. 

Therefore, it is an object of the present invention to increase inter-slice resolution. 
5 It is another object of the present invention to improve tissue contrast. 

It is still another object of the present invention to improve inter-slice resolution and 
tissue contrast simultaneously. 

It is yet another object to provide a simple technique for image registration. 
To achieve the above and other obj ects, the present invention is directed to a system and 
1 0 method for creating high-resolution MRI volumes and also high-resolution, multi-spectral MRI 
volumes. At least one additional scan is obtained in an orthogonal direction. Then, through a 
= data fusion technique, the information from an original scan and an orthogonal scan are 
combined, so as to produce a high-resolution, 3D volume. In addition, one may use a different 
pulse sequence in the original orientation or in an orthogonal orientation, and a data fusion 
1 5 technique can be applied to register the information and then visualize a high-resolution, multi- 
spectral volume. 
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Brief Description of the Drawings 

A preferred embodiment will be set forth in detail with reference to the drawings, in 

which: 

Fig. 1 shows a block diagram of an MRI system according to the preferred embodiment; 
Figs. 2 and 3 show flow charts showing steps performed in registering and rasing two 
images; 

Fig. 4 shows a blurring effect caused by the correlation of the two images; 

Figs. 5A-5C show a typical signal, its gradient and a comparison of the autocorrelations 
of the signal and its gradient, respectively; 

Figs. 6A and 6B show two voxels scanned in orthogonal directions; 

Fig. 6C shows the problem of deriving high-resolution information from the voxels of 
Figs. 6 A and 6B; 

Figs. 7A-7I show comparisons between the individual scans and the fused image; 

Figs. 8A-8I show a comparison among simple fusion without registration, simple fusion 
after registration and complete fusion; 

Figs. 9A-9I show fusion of orthogonal images without correlation; 

Figs. 10A and 10B show images taken with three and four local receiver coils, 
respectively; 

Figs. 1 1A and 1 IB show a two-band spectral image of a knee; and 

Figs. 1 1C and 1 ID show principal components of the image of Figs. 1 1 A and 1 IB. 
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Detailed Description of the Preferred Embodiment 

A preferred embodiment of the present invention will now be set forth in detail with 
reference to the drawings. 

Fig. 1 shows a block diagram of an MRI system 100 on which the present invention can 
5 be implemented. The system 100 uses an RF coil 102 and a gradient coil 104 to apply the 
required RF and gradient fields to the subject S. A spectrometer 106, acting under the control 
of a computer 108, generates gradient signals which are amplified by an X amplifier 110, a Y 
amplifier 112 and a Z amplifier 114 and applied to the gradient coil 104 to produce the gradient 
fields. The spectrometer 106 also generates RF signals which are amplified by an RF amplifier 
10 116 and applied to the RF coil 102 to produce the RF fields. The free induction decay radiation 
from the sample S is detected by the RF coil 102 or by one or more local receiving coils 118 and 
applied to the spectrometer 1 06, where it is converted into a signal which the computer 108 can 
analyze. 

The computer 1 08 should be sufficiently powerful to run a mathematical analysis package 
15 such as AVS, a product of Advanced Visualization Systems of Waltham, Massachusetts, U.S.A. 
Examples are the Apple Power Macintosh and any IBM-compatible microcomputer capable of 
running Windows 95, 98 or NT. The significance of the local receiving coils 118, and 
particularly of the number used, will be explained in detail below. The other components of the 
system 1 00 will be familiar to those skilled in the art and will therefore not be described in detail 
20 here. 

The various techniques to enhance the images will now be described in detail. 
Inter-Slice Resolution 

The inter-slice resolution problem is solved by using two volumetric data sets where 
scanning directions are orthogonal to each other, and fusing them in a single high-resolution 
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image. Fig. 2 shows an overview of the process. First, in step 202, a first scan of the subject is 
taken. In step 204, a second scan of the subject is taken in a direction orthogonal to that of the 
first scan. Third, in step 206, the images are registered. Finally, in step 208, the images are 
fused. Fig. 3 shows the steps involved in image registration. In step 302, gradients of the image 
5 data are formed. In step 304, the gradients are correlated. In step 306, the correlation is 
maximized through a hill-climbing technique. 

Although the fusion of the two volumes seems to be trivial, two issues have to be taken 
into account: 1) the registration among volumes scanned at different time (step 206) and 2) the 
l overlapping of sampling voxel volumes (step 208). Those issues are handled in ways which will 
10 now be described. 

Image Registration fStep 206) 
The goal of image registration is to create a high-resolution 3D image from the fusion of 
the two data sets. Therefore, the registration of both volumes has to be as accurate as the in-plane 
resolution. The preferred embodiment provides a very simple technique to register two very 
T5 similar orthogonal MRI images. The registration is done by assuming a simple translation model 
and neglecting the rotation among the two volumes, thus providing a fair model for small and 
involuntary human motion between scans. 

An unsupervised registration algorithm finds the point (x, y, z) where the correlation 
between the two data sets is maximum. The Schwartz inequality identifies that point as the point 
20 where they match. Given two functions u(x, y, z) and v(x, y, z), the correlation is given by: 

r(x,y,z) = u(x,y,z)*v(x,y,z) = JJjw(# ,/?,/)v(x + a, y + (3 \z + y)dadfidy . 

lfu(x, y, z) is just a displaced version of v(x, y, z), or in other words, u(x, y, z) = v(x+Ax, y+Ay, 
z+Az), then the maximum is at (-Ax, -Ay, -Az), the displacement between the functions. 
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In MRI, every voxel in the magnetic resonance image observes the average magnetization 
of an ensemble of protons in a small volume. The voxel can therefore be modeled as the 
correlation of the continuous image by a small 3D window. Let g x (x, y, z) and g 2 (x, y, z) be the 
sampled volumes at two orthogonal directions, which are given by: 

g x (x,y,z) = /(x,^,z)*w 1 (x,7,z)*n(x,7,z) 

g 2 (x,y,z) = f(x + Ax,y + Ay,z + Az)*w 2 (x,y,z)*Tl(x,y,z) 

5 where w x {x, y, z) and w 2 (x, y, z) are the 3D windows for the two orthogonal scanning directions, 
(Ax, Ay, Az) is a small displacement, and II(x, y, z) is the sampling function. Therefore, the 
correlation of the two sampled volumes is 

r(x,y,z) = g t (x,y,z)*g 2 (x,y,z) 

= f(x+ Ax,y+ Ay,z+ Az)* f(x,y,z)*w l (x,y,z)*w 2 (x,y,z)*Il(x,y,z). 

That is just a blurred version of the original correlation; the exact location of the maxima is 
shaped by the blurring function h(x, y, z) = w x (x, y, z) * w 2 (x, y, z). That is, the correlation is 

] O distorted by the function h(x, y, z). Fig. 4 shows an idealized window function for w { (x, y, z) and 
w 2 (x, y, z) and its corresponding supporting region of the blurring function, h(x, y, z). 

Finding the displacement using the above procedure works fine for noise-free data, but 
noise makes the search more difficult. Letgj(x, y, z) = (f[x, y, z)+n l (x, y, z)) * w x (x, y, z) andg 2 (x, 
y, z) = (f(x+Ax, y+Ay, z+Az)+n 2 (x, y, z)) * w 2 (x, y, z) be the corresponding noisy volumes, where 

15 n x {x,y, z) and n 2 (x, y, z) are two uncorrected noise sources. Thus, the correlation of g x and g 2 
is given by 

r(x,y,z)= g l (x,y,z)*g 2 (x,y,z) 

= [f(x+ Ax,y+ Ay,z+ Az)* f(x,y,z) + 
f(x+ Ax,y+ Ay,z+ Az)*n l {x,y r) z)^ 
f (x, y, z) * n 2 (x, y, z)~] *h(x,y,z)*U(x,y, z), 
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and the maximum is no longer guaranteed to be given by the displacement, especially for 
functions with smooth autocorrelation functions like standard MRI. The smooth autocorrelation 
functions make the error a function of the noise power. Autocorrelation functions whose shapes 
are closer to a Dirac delta function S(;c, y, z) are less sensitive to noise, which is the reason why 
many registration algorithms work with edges. The autocorrelation function of the gradient 
magnitude of standard MRI is closer to a Dirac delta function. Therefore, the registration of the 
gradient is less sensitive to noise. 

Figs. 5A-5C shows a ID example of the effect of the derivative on the autocorrelation 
function of a band-limited signal. Fig. 5 A shows an original signal/*). Fig. 5B shows a smooth 
estimate of the magnitude of the derivative, namely, 

g(*)=|/(*)*[-l -1 0 0 0 1 l] 

Fig. 5C shows autocorrelations; the dashed curve represents/*/, while the curve shown in 
crosses represents g * g. For that example, a smooth derivative operator is used to reduce the 
noise level. 

For the above reasons, the automatic registration is based on finding the maximum on the 
correlation among the magnitude gradient of the two magnetic resonance images: 
(Ax,A>>,Az) = Arg max jj|||Vg 1 («,^,/)||||Vg 2 (Ax+ a,Ay + J3,Az + y)\dad(]dy . 

In sampled images the gradient V can be approximated by finite differences: 
\\Vg(x,y,z)\\ = ^d x (x,y,z) 2 + d y (x,y,z) 2 + d z (x,y,z) 2 , 



where 



d x (x,y,z) = 



l(x,y,z)*g(x+ Sx,y,z)- l(x,y,z)* g(x- Sx,y,z) 
2Sx 



d y (x,y,z) = 



l(x,y,z)* g(x,y+ 5y,z)- l(x,y,z)* g(x,y- Sy,z) 
28y 



d z (x,y,z) = 



l(x,y,z)*g(x,y,z+ Sz) - l(x,y,z)*g(x,y,z- Sz) 
25z 



where bx, by, bz are the sampling rates, and l(x, y, z) is a low pass filter used to remove noise 
from the images and to compensate the differences between in-slice sampling and inter-slice 
sampling. 

The maximization can be done using any standard maximization technique. The preferred 
embodiment uses a simple hill-climbing technique because of the small displacements. The hill- 
climbing technique evaluates the correlation at the six orthogonal directions: up, down, left, right, 
front and back. The direction that has the biggest value is chosen as the next position. That 
simple technique works well for the registration of two orthogonal data sets, as the one expects 
for involuntary motion during scans. 

To avoid being trapped in local maxima and to speed up the process, a multi-resolution 
approach can be used. That multi-resolution approach selects the hill-climbing step as half the 
size of the previous step. Five different resolutions are used. The coarsest resolution selected is 
twice the in-plane resolution of the system, and the smallest size is just 25 percent of the in-plane 
resolution. 

Even with a very simple optimization approach, the computation of the correlation of the 
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whole data set can be time consuming; therefore, the registration of two images can take time. 

To speed up the correlation of the two data sets, just a small subsample of the points with very 

high gradient are selected for use in the correlation process. 

Some images suffer from a small rotation. In that case, the algorithm is extended to search 
5 for the image rotation. The same hill-climbing technique is used to find the rotation between 

images; but instead of doing the search in a three-dimensional space, the algorithm has to look 

at a six-dimensional space. That search space includes the three displacements and three rotations 

along each axis. At each step the rotation matrix is updated and used to compensate for the small 

rotation between images. 
lb Image Fusion (Step 208) 

Once the two images are registered, an isotropic high resolution image is created from 

them. Due to the different shape between voxel sampling volumes (w 2 (x, y, z) and w^x, y, zj), 

one has to be careful when estimating every high resolution voxel value from the input data. 

Assume that the first image has been scanned in the ^-direction and the second has been scanned 
15 in the y-direction. Therefore, there is high-resolution information in the z-direction in both 

images. 

Figs. 6A and 6B show the voxel shapes of the two input images, where the in-slice 
resolution is equal, and the inter-slice resolution is four times lower. Given that configuration, 
the problem of filling the high-resolution volume is a 2D problem. In a single 4^4- voxel window 
20 of the high resolution image, as seen in Fig. 6C, then for every 16 high-resolution voxels there 
are only 8 known low-resolution voxels; therefore, that is an ill posed problem. 

To address that problem, assume that every high-resolution voxel is just a linear 
combination of the two low-resolution functions: 

g(x, y,z)=h 1 (x/s d ,y,z)+h 2 (x,y/s d ,z), 
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where h u h 2 are two functions which are back projected in such a way that 
g l (x/s d ,y,z)= g(x,y,z), 

g 2 (x,y/s d ,z) = Yug( x >y> z )' 

Vyew 2 

That represents a linear system with the same number of knowns as unknowns. The known 
values are the observed image voxels, while the values to back-project which match the 
observation are estimated. Noise and inhomogeneous sampling make the problem a little bit 
harder; but that linear system can efficiently be solved using projection on convex sets (POCS). 
Although, in theory, all the components have to be orthogonally projected, it can be shown that 
the following projecting scheme also works: 

h k x + \xls d ,y,z)= ht{xls di y,z)- 

(nh 1 k (xis d ,y,z) + Ys^&y 1 s d> z )~ 8i( x/ s a>y> z )) n 

a- —, " ' 

n + m 

f4 + \x,y/s d ,z)=Pi{x,yls d ,z)- 

(mh^(x,y/s d ,z)+ J^h^x/ s d ,y,z)- g 2 (x,y/ s d ,z))m 

a ~ 2 " ' 

n+m 

where 0 < a < 1, n = the window size of w u m = the window size of w 2 , h x \x, y, z) =g(x, y, z) 
and h 2 °(x, y, z) = g 2 (x, y, z) are the initial guesses for the estimation of back-projected functions. 
The advantage of that approach over standard orthogonal projection is that is equations are 
simpler and that they can be implemented efficiently on a computer. 
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Experimental Data 

Some experimental data produced by the above technique will now be described. 
Figs. 7 A, 7B and 7C respectively show the original MRI sagittal scan, the original MRI 
axial scan and the fused image of a human shoulder seen along an axial view. Figs. ID, 7E and 
5 7F show the same, except seen along a sagittal view. Figs. 7G, 7H and 71 show the same, except 
seen along a coronal view, hi all three cases, the image is noticeably improved. 

Figs. 8 A, 8B and 8C show axial, sagittal and coronal slices, respectively, of simple fusion 
without registration. Figs. 8D, 8E and 8F show the same slices with simple fusion after 
registration. Figs. 8G, 8H and 81 show the same slices with complete image fusion. The simple 
10 fusion is g(x, y, z) = 0.5 ^(jc, y, z) + 0.5g 2 (x, y, z), and the complete fusion is g(x, y, z) = h^x, y, 
z) + h 2 (x, y, z), wherein \ and h 2 are the two functions which minimize the reconstruction error. 
~ Figs. 9A-9I show fusion of orthogonal images without correlation. Figs. 9A, 9B and 9C 

show axial views of the original MRI sagittal scan, the original axial scan and the fused image, 
respectively, for an axial view. Figs. 9D, 9E and 9F show the same for a sagittal view. Figs. 9G, 
15 9H and 91 show the same for a coronal view. 

Multiple Local Coil Receivers and Multispectral Imaging 

Good signal-to-noise ratio is very important for an unsupervised segmentation algorithm. 
Even more important is the contrast-to-noise ratio among neighboring tissues. When local 
receiving coils are used, the signal from points far from the coil location is weak; therefore, 
20 contrast among tissues located far from the receiving coil is low. Some researchers have 
proposed several software alternatives to correct this signal fading, but this will increase the noise 
levels as well. Thus, it will not solve the problem. The preferred embodiment uses two or more 
receiving coils, which will improve the signal reception at far locations. 

Figs. 10A and 10B show the advantage of using multiple coils. Fig. 10A shows an MRI 
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image of a knee using three surface coils. Fig. 10B shows an MRI image of the same knee using 
four surface coils. 

Multispectral images will now be considered. Such images can be analogized to 
multispectral optical images, in which, for example, red, blue and green images are combined 
5 to create a single color image. 

Figs. 1 1 A and 1 IB show a two-band spectral image of a knee. Fig. 1 1 A shows a cross 
section of a fat suppression MRI scan of the knee, where fat, and bone tissues have almost the 
same low density, cartilage has a very high density, and muscle tissue has a medium density. Fig. 
1 IB shows the same knee, but now, muscle tissue and cartilage have the same density, making 
"10 them very hard to differentiate. Those images clearly show the advantage of the multispectral 
image approach in describing the anatomy. 

The analysis of a multispectral image is more complex than that of a single-spectrum 
image. One way to simplify the analysis is to reduce the number of bands by transforming an N- 
band multispectral image in such a way that passes the most relevant image into an (iV-n)-band 
•1 5 image. The transform that minimizes the square error between the (A L «)-band image and the N- 
band image is the discrete Karhuen-Loeve (K-L) transform. The resulting individual images from 
the transformed spectral image after applying the K-L transform are typically known as the 
principal components of the image. 

Let the voxel x be an //-dimensional vector whose elements are the voxel density from 
20 each individual pulse sequence. Then the vector mean value of the image is defined as 

j M 

m « =£[x]= M£ x " 

and the covariance matrix is defined as 
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j M 

C x = E[(x- m x )(x- m x ) 2 ] = — X x k x T k - m k m T k , 

1V1 k=i 

where Mis the number of voxels in the image. 

Because C x is real and symmetric, a set of n orthogonal eigenvectors can be found. Let 
e ( and X t , i= 1, 2, ... iV, be the eigenvectors and the corresponding eigenvalues of C x , so that Xj 
> X J+l . Let A be the matrix formed with the eigenvectors of C^. Then the transformation 
y = A(x- m) x 

is the discrete K-L transform, andy,, i = 1, 2, ... N, are the components of a multispectral image. 
Figs. 11C and 1 ID show the principal components of the two-band spectral image shown in Figs. 
1 1 A and 1 IB. The advantage of the K-L decomposition of a multispectral image is that the 
image with the highest contrast is associated with the highest eigenvalue of the correlation 
matrix, and the image associated with the smallest eigenvalues usually is irrelevant. 

The high-contrast, multispectral images thus formed can be utilized for diagnosis and for 
input to post-processing systems, such as three-dimensional rendering and visualization systems. 
If the multispectral data are from orthogonal planes or are acquired with some misregistration, 
the registration and orthogonal fusion steps described herein can be employed to enhance the 
resolution and contrast. 

While a preferred embodiment of the present invention has been set forth above, those 
skilled in the art who have reviewed the present disclosure will readily appreciate that other 
embodiments can be realized within the scope of the present invention. For example, while the 
invention has been disclosed as used with the hardware of Fig. 1, other suitable MRI hardware 
can be used. For that matter, the invention can be adapted to imaging techniques other than MRI, 
such as tomography. Also, while the scans are disclosed as being in orthogonal directions, they 
can be taken in two different but non-orthogonal directions. Therefore, the present invention 
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should be construed as limited only by the appended claims. 
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What is claimed is : 

1. ^method of forming an image of a subject, the method comprising: 

f{a) scanning the subject in a first direction to take image data of a first plurality of slices; 

(b) scanning the subject in a second direction which is different from the first direction 
to take image data of a second plurality of slices; 

(c) registering the first plurality of slices with the second plurality of slices; and 

(d) fusing the first plurality of slices with the second plurality of slices to form the image. 

2. The method of claim 1 , wherein the second direction is orthogonal to the first direction. 

3. The method of claim 1, wherein steps (a) and (b) are performed with magnetic 
resonance imaging. 

4. The method of claim 1 , wherein step (c) comprises maximizing a correlation based on 
the image data of the first and second pluralities of slices. 

5. The method of claim 4, wherein the correlation is a correlation of gradients of the 
image data of the first and second pluralities of slices. 

6. The method of claim 5, wherein the correlation is maximized through a hill-climbing 
technique. 

7. The method of claim 6, wherein the hill-climbing technique is a multiresolution hill- 
climbing technique. 

8. The method of claim 7, wherein: 

steps (a) and (b) are performed with a device having an in-plane resolution; and 
the multiresolution hill-climbing technique is performed with a plurality of resolutions 
including: 

(i) a maximum resolution which is twice the in-plane resolution; and 

(ii) a minimum resolution which is one-quarter of the in-plane resolution. 
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9. The method of claim 6, wherein the hill-climbing technique is used to determine both 
a relative displacement and a relative rotation between the first and second pluralities of slices. 

10. The method of claim 5, wherein the correlation is a correlation of a subsample of the 
image data of the first plurality of slices with a subsample of the image data of the second 

5 plurality of slices, the subsamples being taken in accordance with gradients of the image data. 

1 1 . The method of claim 1 , wherein: 

the image data of the first plurality of slices have a low resolution in the first direction 
and a high resolution in directions orthogonal to the first direction; 

the image data of the second plurality of slices have the low resolution in the second 
JO direction and the high resolution in directions orthogonal to the second direction; and 

step (d) comprises fusing the first plurality of slices with the second plurality of slices 
such that the image has the high resolution in all directions. 

12. The method of claim 11, wherein step (d) comprises treating the image as a linear 
combination of functions having the low resolution and deriving the functions from the image 

i 5 data of the first and second pluralities of slices. 

13. The method of claim 12, wherein the functions are derived through an iterative 
process using the image data of the first and second pluralities of slices as initial assumptions for 
the functions. 

14. The method of claim 1, wherein steps (a) and (b) are performed using MRI with a 
20 plurality of receiving coils. 

15. The method of claim 14, wherein steps (a) and (b) are performed using at least three 
receiving coils. 

16. The method of claim 15, wherein steps (a) and (b) are performed using at least four 
receiving coils. 
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17. The method of claim 1, wherein: 

steps (a) and (b) are performed through MRI; and 

the image data of the first plurality of slices and the image data of the second plurality of 
slices comprise image data having a plurality of spectral bands. 
5 18. The method of claim 17, wherein step (d) comprises selecting a subplurality of the 

plurality of spectral bands to form the image. 

19. The method of claim 18, wherein the subplurality of the plurality of spectral bands 
is selected by ranking the plurality of spectral bands in order of image contrast and selecting the 
spectral bands whose image contrast is highest. 
10 20. The method of claim 1 9, wherein the plurality of spectral bands is ranked in order of 

image contrast by: 

deriving a covariance matrix from the plurality of spectral bands; 

deriving a set of orthogonal eigenvectors and a corresponding set of eigenvalues from the 
covariance matrix; and 

1 5 ranking the orthogonal eigenvectors in order of their corresponding eigenvalues. 

A method of forming an image of a subject, the method comprising: 

(a) performing an MRI scan on the subject to take image data having a plurality of 
spectral bands; and 

(b) forming the image from the image data. 

20 22. The method of claim 21, wherein step (b) comprises selecting a subplurality of the 

plurality of spectral bands to form the image. 

23. The method of claim 22, wherein the subplurality of the plurality of spectral bands 
is selected by ranking the plurality of spectral bands in order of image contrast and selecting the 
spectral bands whose image contrast is highest. 
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24. The method of claim 23, wherein the plurality of spectral bands is ranked in order of 
image contrast by: 

deriving a covariance matrix from the plurality of spectral bands; 
deriving a set of orthogonal eigenvectors and a corresponding set of eigenvalues from the 
covariance matrix; and 

ranking the orthogonal eigenvectors in order of their corresponding eigenvalues. 

25. The method of claim 21, wherein step (a) is performed with a plurality of receiving 

coils. 

26. The method of claim 25, wherein step (a) is performed using at least three receiving 

coils. 

27. The method of claim 26, wherein step (a) is performed using at least four receiving 

coils. 



scanning means for (i) scanning the subject in a first direction to take image data of a first 
plurality of slices and (ii) scanning the subject in a second direction which is different from the 
first direction to take image data of a second plurality of slices; and 

computing means for (i) registering the first plurality of slices with the second plurality 
of slices and (ii) fusing the first plurality of slices with the second plurality of slices to form the 
image. 

29. The system of claim 28, wherein the second direction is orthogonal to the first 
direction. 

30. The system of claim 28, wherein the scanning means comprises an MRI scanner. 

3 1 . The system of claim 28, wherein the computing means registers the first and second 
pluralities of slices by maximizing a correlation based on the image data of the first and second 




A system for forming an image of a subject, the system comprising: 
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pluralities of slices. 

32. The system of claim 31, wherein the correlation is a correlation of gradients of the 
image data of the first and second pluralities of slices. 

33 . The system of claim 32, wherein the correlation is maximized through a hill-climbing 
technique. 

34. The system of claim 33, wherein the hill-climbing technique is a multiresolution hill- 
climbing technique. 

35. The system of claim 34, wherein: 

the scanning means has an in-plane resolution; and 

the multiresolution hill-climbing technique is performed with a plurality of resolutions 
including: 

(i) a maximum resolution which is twice the in-plane resolution; and 

(ii) a minimum resolution which is one-quarter of the in-plane resolution. 

36. The system of claim 35, wherein the hill-climbing technique is used to determine both 
a relative displacement and a relative rotation between the first and second pluralities of slices. 

37. The system of claim 32, wherein the correlation is a correlation of a subsample of the 
image data of the first plurality of slices with a subsample of the image data of the second 
plurality of slices, the subsamples being taken in accordance with gradients of the image data. 

38. The system of claim 28, wherein: 

the image data of the first plurality of slices have a low resolution in the first direction 
and a high resolution in directions orthogonal to the first direction; 

the image data of the second plurality of slices have the low resolution in the second 
direction and the high resolution in directions orthogonal to the second direction; and 

the computing means fuses the first plurality of slices with the second plurality of slices 
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such that the image has the high resolution in all directions. 

39. The system of claim 38, wherein the computing means treats the image as a linear 
combination of functions having the low resolution and deriving the functions from the image 
data of the first and second pluralities of slices. 
5 40. The system of claim 39, wherein the functions are derived through an iterative process 

using the image data of the first and second pluralities of slices as initial assumptions for the 
functions. 

41 . The system of claim 28, wherein the scanning means comprises an MRI scanner with 
a plurality of receiving coils. 
10 42. The system of claim 41, wherein the plurality of receiving coils comprises at least 

three receiving coils. 

43. The system of claim 42, wherein the plurality of receiving coils comprises at least 
four receiving coils. 

44. The system of claim 28, wherein: 

15 the scanning means comprises an MRI scanner; and 

the image data of the first plurality of slices and the image data of the second plurality of 
slices comprise image data having a plurality of spectral bands. 

45. The system of claim 41, wherein the computing means selects a subplurality of the 
plurality of spectral bands to form the image. 

20 46. The system of claim 45, wherein the subplurality of the plurality of spectral bands is 

selected by ranking the plurality of spectral bands in order of image contrast and selecting the 
spectral bands whose image contrast is highest. 

47. The system of claim 46, wherein the plurality of spectral bands is ranked in order of 
image contrast by: 
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deriving a covariance matrix from the plurality of spectral bands; 

deriving a set of orthogonal eigenvectors and a corresponding set of eigenvalues from the 
covariance matrix; and 

ranking the orthogonal eigenvectors in order of their corresponding eigenvalues. 

^8^A system for forming an image of a subject, the system comprising: 

scanning means for performing an MRI scan on the subject to take image data having a 
plurality of spectral bands; and 

computing means for forming the image from the image data. 

49. The system of claim 48, wherein the computing means selects a subplurality of the 
plurality of spectral bands to form the image. 

50. The system of claim 49, wherein the subplurality of the plurality of spectral bands is 
selected by ranking the plurality of spectral bands in order of image contrast and selecting the 
spectral bands whose image contrast is highest. 

5 1 . The system of claim 5 0, wherein the plurality of spectral bands is ranked in order of 
image contrast by: 

deriving a covariance matrix from the plurality of spectral bands; 
deriving a set of orthogonal eigenvectors and a corresponding set of eigenvalues from the 
covariance matrix; and 

ranking the orthogonal eigenvectors in order of their corresponding eigenvalues. 

52. The system of claim 48, wherein the scanning means comprises a plurality of 
receiving coils. 

53. The system of claim 52, wherein the plurality of receiving coils comprises at least 
three receiving coils. 

54. The system of claim 53, wherein the plurality of receiving coils comprises at least 
four receiving coils. 
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Abstract of the Disclosure 

MRI scans typically have higher resolution within a slice than between slices. To 
improve the resolution, two MRI scans are taken in different, preferably orthogonal, directions. 
The scans are registered by maximizing a correlation between their gradients and then fused to 
form a high-resolution image. Multiple receiving coils can be used. When the images are 
multispectral, the number of spectral bands is reduced by transformation of the spectral bands 
in order of image contrast and using the transformed spectral bands with the highest contrast. 
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